2026-10-26 12:08:39,569 [ 87585 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-10-26 12:08:39,569 [ 87585 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-10-26 12:08:39,569 [ 87585 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-10-26 12:08:39,569 [ 87585 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_ugh3i4 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv test_disks_app_func/test.py::test_disks_app_func_read_write test_disks_app_func/test.py::test_disks_app_func_rm test_disks_app_func/test.py::test_remote_disk_list test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_password/test.py::test_alter test_distributed_ddl_password/test.py::test_truncate test_distributed_system_query/test.py::test_start_and_stop_replica_send test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk/test.py::test_add_keys test_encrypted_disk/test.py::test_add_keys_with_id 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False]' 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True]' -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_disks_app_func/test.py::test_disks_app_func_cp test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disk_over_web_server/test.py::test_cache[node2] test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_buffer_profile/test.py::test_buffer_profile test_ddl_alter_query/test.py::test_alter test_encrypted_disk/test.py::test_add_keys [gw8] [ 1%] PASSED test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile [gw8] [ 2%] PASSED test_buffer_profile/test.py::test_default_profile test_aggregation_memory_efficient/test.py::test_remote [gw3] [ 3%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw7] [ 4%] PASSED test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible [gw7] [ 5%] PASSED test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible [gw3] [ 6%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_distributed_ddl_password/test.py::test_alter [gw3] [ 7%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw3] [ 8%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw0] [ 9%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] [gw3] [ 10%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] [gw9] [ 11%] PASSED test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change [gw0] [ 12%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] [gw8] [ 13%] PASSED test_aggregation_memory_efficient/test.py::test_remote [gw0] [ 14%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] [gw9] [ 15%] PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts [gw6] [ 16%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] [gw0] [ 17%] PASSED test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica [gw3] [ 18%] PASSED test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes [gw0] [ 19%] PASSED test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_config_xml_yaml_mix/test.py::test_extra_yaml_mix [gw0] [ 20%] PASSED test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication [gw0] [ 21%] PASSED test_backup_restore_on_cluster/test.py::test_file_deduplication [gw4] [ 22%] PASSED test_disk_over_web_server/test.py::test_cache[node2] test_disk_over_web_server/test.py::test_incorrect_usage [gw7] [ 23%] PASSED test_distributed_ddl_password/test.py::test_alter test_distributed_ddl_password/test.py::test_truncate test_backup_restore_on_cluster/test.py::test_get_error_from_other_host [gw0] [ 24%] PASSED test_backup_restore_on_cluster/test.py::test_get_error_from_other_host [gw4] [ 25%] PASSED test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_replicated_database [gw6] [ 26%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] test_backup_restore_on_cluster/test.py::test_keeper_value_max_size [gw4] [ 27%] PASSED test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server [gw7] [ 28%] PASSED test_distributed_ddl_password/test.py::test_truncate [gw3] [ 29%] PASSED test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_detached_parts_metrics/test.py::test_numbers_of_detached_parts [gw0] [ 30%] PASSED test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_cleanup_after_start/test.py::test_old_dirs_cleanup [gw9] [ 31%] PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async [gw0] [ 32%] PASSED test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection [gw3] [ 33%] PASSED test_detached_parts_metrics/test.py::test_numbers_of_detached_parts [gw0] [ 34%] PASSED test_backup_restore_on_cluster/test.py::test_projection test_default_database_on_cluster/test.py::test_default_database_on_cluster test_backup_restore_on_cluster/test.py::test_replicated_database [gw0] [ 35%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async [gw0] [ 36%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts [gw7] [ 37%] PASSED test_cleanup_after_start/test.py::test_old_dirs_cleanup [gw6] [ 38%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] [gw0] [ 39%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts test_backup_restore_on_cluster/test.py::test_replicated_table test_distributed_system_query/test.py::test_start_and_stop_replica_send [gw8] [ 40%] PASSED test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts [gw0] [ 41%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_cgroup_limit/test.py::test_cgroup_cpu_limit [gw6] [ 42%] PASSED test_distributed_system_query/test.py::test_start_and_stop_replica_send [gw0] [ 43%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster [gw0] [ 44%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def [gw4] [ 45%] PASSED test_disk_over_web_server/test.py::test_unavailable_server test_disk_over_web_server/test.py::test_usage[node2] [gw9] [ 46%] PASSED test_default_database_on_cluster/test.py::test_default_database_on_cluster [gw0] [ 47%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_enabling_access_management/test.py::test_enabling_access_management [gw0] [ 48%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert [gw8] [ 49%] PASSED test_cgroup_limit/test.py::test_cgroup_cpu_limit test_distributed_config/test.py::test_distibuted_settings [gw4] [ 50%] PASSED test_disk_over_web_server/test.py::test_usage[node2] test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge [gw0] [ 51%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath [gw8] [ 52%] PASSED test_distributed_config/test.py::test_distibuted_settings [gw9] [ 53%] PASSED test_enabling_access_management/test.py::test_enabling_access_management [gw0] [ 54%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges [gw0] [ 55%] PASSED test_backup_restore_on_cluster/test.py::test_required_privileges test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] [gw0] [ 56%] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] [gw0] [ 57%] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] test_backup_restore_on_cluster/test.py::test_system_functions [gw0] [ 58%] PASSED test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users [gw0] [ 59%] PASSED test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def [gw0] [ 60%] PASSED test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty [gw0] [ 61%] PASSED test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency [gw0] [ 62%] PASSED test_backup_restore_on_cluster/test.py::test_tables_dependency [gw5] [ 63%] ERROR test_encrypted_disk/test.py::test_add_keys test_encrypted_disk/test.py::test_add_keys_with_id [gw2] [ 64%] ERROR test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld [gw5] [ 65%] ERROR test_encrypted_disk/test.py::test_add_keys_with_id test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False] [gw1] [ 66%] ERROR test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] [gw2] [ 67%] ERROR test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln [gw1] [ 68%] ERROR test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries [gw5] [ 69%] ERROR test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False] test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True] [gw2] [ 70%] ERROR test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls [gw5] [ 71%] ERROR test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True] [gw2] [ 72%] ERROR test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv [gw1] [ 73%] ERROR test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works [gw1] [ 74%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] [gw2] [ 75%] ERROR test_disks_app_func/test.py::test_disks_app_func_mv test_disks_app_func/test.py::test_disks_app_func_read_write [gw1] [ 76%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] [gw2] [ 77%] ERROR test_disks_app_func/test.py::test_disks_app_func_read_write test_disks_app_func/test.py::test_disks_app_func_rm [gw1] [ 78%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] [gw2] [ 79%] ERROR test_disks_app_func/test.py::test_disks_app_func_rm test_disks_app_func/test.py::test_remote_disk_list [gw1] [ 80%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] [gw2] [ 81%] ERROR test_disks_app_func/test.py::test_remote_disk_list [gw1] [ 82%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] [gw1] [ 83%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] [gw1] [ 84%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] [gw1] [ 85%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] [gw1] [ 86%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] [gw1] [ 87%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] [gw1] [ 88%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] [gw1] [ 89%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] [gw1] [ 90%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] [gw1] [ 91%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] [gw1] [ 92%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] [gw1] [ 93%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] [gw1] [ 94%] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried [gw1] [ 95%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried [gw1] [ 96%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] [gw1] [ 97%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] [gw1] [ 98%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] [gw1] [ 99%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] [gw1] [100%] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] ==================================== ERRORS ==================================== _______________________ ERROR at setup of test_add_keys ________________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk/test.py:26: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:08:43 [ 534 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 534 ] INFO : Running tests in /ClickHouse/tests/integration/test_encrypted_disk/test.py (cluster.py:2659, start) 2026-10-26 12:08:43 [ 534 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker networks for project roottestencrypteddisk are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker containers for project roottestencrypteddisk are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker volumes for project roottestencrypteddisk are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker networks for project roottestencrypteddisk are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker containers for project roottestencrypteddisk are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Docker volumes for project roottestencrypteddisk are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddisk_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : No running containers for project: roottestencrypteddisk (cluster.py:829, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 534 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 12:08:43 [ 534 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_encrypted_disk/configs/storage.xml', '/ClickHouse/tests/integration/test_encrypted_disk/configs/allow_backup_path.xml'] to /ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/database (cluster.py:4488, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/logs (cluster.py:4499, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:08:43 [ 534 ] INFO : external_dir_abs_path=/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/backups (cluster.py:4629, create_dir) 2026-10-26 12:08:43 [ 534 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:08:43 [ 534 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 534 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 534 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 534 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 534 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:08:43 [ 534 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:09:37 [ 534 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:09:37 [ 534 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:10:31 [ 534 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:10:34 [ 534 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:11:21 [ 534 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:11:27 [ 534 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:12:20 [ 534 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:12:29 [ 534 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:13:23 [ 534 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:13:23 [ 534 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 534 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker networks for project roottestencrypteddisk are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker containers for project roottestencrypteddisk are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker volumes for project roottestencrypteddisk are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddisk_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : No running containers for project: roottestencrypteddisk (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 534 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 534 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker networks for project roottestencrypteddisk are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker containers for project roottestencrypteddisk are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Docker volumes for project roottestencrypteddisk are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddisk_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : No running containers for project: roottestencrypteddisk (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 534 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 534 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ___________________ ERROR at setup of test_disks_app_func_cp ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling disks_app_test ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling disks_app_test ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:08:43 [ 525 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV HOSTNAME 8d38b5272b0f (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv test_disks_app_func/test.py::test_disks_app_func_read_write test_disks_app_func/test.py::test_disks_app_func_rm test_disks_app_func/test.py::test_remote_disk_list test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_password/test.py::test_alter test_distributed_ddl_password/test.py::test_truncate test_distributed_system_query/test.py::test_start_and_stop_replica_send test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk/test.py::test_add_keys test_encrypted_disk/test.py::test_add_keys_with_id 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False]' 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True]' -vvv (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID b01101378ef849b28b7c88392ba1adc8 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTEST_XDIST_WORKER gw2 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : ENV PYTEST_CURRENT_TEST test_disks_app_func/test.py::test_disks_app_func_cp (setup) (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:08:43 [ 525 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:08:43 [ 525 ] DEBUG : Cluster name: project_name:roottestdisksappfunc. Added instance name:disks_app_test tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:08:43 [ 525 ] INFO : Running tests in /ClickHouse/tests/integration/test_disks_app_func/test.py (cluster.py:2659, start) 2026-10-26 12:08:43 [ 525 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker networks for project roottestdisksappfunc are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker containers for project roottestdisksappfunc are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker volumes for project roottestdisksappfunc are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker networks for project roottestdisksappfunc are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker containers for project roottestdisksappfunc are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Docker volumes for project roottestdisksappfunc are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:docker container list --all --filter name='^/roottestdisksappfunc_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : No running containers for project: roottestdisksappfunc (cluster.py:829, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 525 ] DEBUG : Setup directory for instance: disks_app_test (cluster.py:2679, start) 2026-10-26 12:08:43 [ 525 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_disks_app_func/config.xml'] to /ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/database (cluster.py:4488, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/logs (cluster.py:4499, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:08:43 [ 525 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:08:43 [ 525 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 525 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 525 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 525 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 525 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:08:43 [ 525 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:09:37 [ 525 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling disks_app_test ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling disks_app_test ... done Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:09:37 [ 525 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:10:31 [ 525 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling disks_app_test ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling disks_app_test ... done Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:10:34 [ 525 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:11:21 [ 525 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling disks_app_test ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling disks_app_test ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:11:27 [ 525 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:12:20 [ 525 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling disks_app_test ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling disks_app_test ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:12:29 [ 525 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling disks_app_test ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling disks_app_test ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling disks_app_test ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... Pulling disks_app_test ... status: image is up to date for a... Pulling disks_app_test ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:13:23 [ 525 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:13:23 [ 525 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 525 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker networks for project roottestdisksappfunc are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker containers for project roottestdisksappfunc are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker volumes for project roottestdisksappfunc are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:docker container list --all --filter name='^/roottestdisksappfunc_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : No running containers for project: roottestdisksappfunc (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 525 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 525 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker networks for project roottestdisksappfunc are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker containers for project roottestdisksappfunc are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Docker volumes for project roottestdisksappfunc are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:docker container list --all --filter name='^/roottestdisksappfunc_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : No running containers for project: roottestdisksappfunc (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 525 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 525 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ___________________ ERROR at setup of test_add_keys_with_id ____________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk/test.py:26: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_adaptive_timeouts[node] ________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_inf_s3_retries ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:08:43 [ 522 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV HOSTNAME 8d38b5272b0f (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv test_disks_app_func/test.py::test_disks_app_func_read_write test_disks_app_func/test.py::test_disks_app_func_rm test_disks_app_func/test.py::test_remote_disk_list test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_password/test.py::test_alter test_distributed_ddl_password/test.py::test_truncate test_distributed_system_query/test.py::test_start_and_stop_replica_send test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk/test.py::test_add_keys test_encrypted_disk/test.py::test_add_keys_with_id 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False]' 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True]' -vvv (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID b01101378ef849b28b7c88392ba1adc8 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTEST_XDIST_WORKER gw1 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : ENV PYTEST_CURRENT_TEST test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] (setup) (cluster.py:400, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:08:43 [ 522 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:08:43 [ 522 ] DEBUG : Cluster name: project_name:roottestcheckings3blobsparanoid. Added instance name:node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:08:43 [ 522 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:08:43 [ 522 ] DEBUG : Cluster name: project_name:roottestcheckings3blobsparanoid. Added instance name:node_with_inf_s3_retries tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:08:43 [ 522 ] INFO : Starting cluster... (test.py:37, cluster) 2026-10-26 12:08:43 [ 522 ] INFO : Running tests in /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/test.py (cluster.py:2659, start) 2026-10-26 12:08:43 [ 522 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker networks for project roottestcheckings3blobsparanoid are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker containers for project roottestcheckings3blobsparanoid are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker volumes for project roottestcheckings3blobsparanoid are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker networks for project roottestcheckings3blobsparanoid are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker containers for project roottestcheckings3blobsparanoid are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Docker volumes for project roottestcheckings3blobsparanoid are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:docker container list --all --filter name='^/roottestcheckings3blobsparanoid_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : No running containers for project: roottestcheckings3blobsparanoid (cluster.py:829, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 12:08:43 [ 522 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/database (cluster.py:4488, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/logs (cluster.py:4499, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup directory for instance: node_with_inf_s3_retries (cluster.py:2679, start) 2026-10-26 12:08:43 [ 522 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/database (cluster.py:4488, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/logs (cluster.py:4499, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:08:43 [ 522 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:08:43 [ 522 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 522 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 522 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:08:43 [ 522 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:08:43 [ 522 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:08:43 [ 522 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... done (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:09:37 [ 522 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:09:37 [ 522 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling node_with_inf_s3_retries ... Pulling resolver ... Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... done Pulling proxy2 ... done Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:09:37 [ 522 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:10:31 [ 522 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:10:31 [ 522 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node ... Pulling node_with_inf_s3_retries ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling proxy2 ... done Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:10:34 [ 522 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... done (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:11:21 [ 522 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:11:21 [ 522 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling node_with_inf_s3_retries ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:11:27 [ 522 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:12:20 [ 522 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:12:20 [ 522 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling node_with_inf_s3_retries ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:12:29 [ 522 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling node_with_inf_s3_retries ... done (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node_with_inf_s3_retries ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... Pulling node_with_inf_s3_retries ... status: image is up to date for a... Pulling node_with_inf_s3_retries ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:13:23 [ 522 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:13:23 [ 522 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 522 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker networks for project roottestcheckings3blobsparanoid are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker containers for project roottestcheckings3blobsparanoid are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker volumes for project roottestcheckings3blobsparanoid are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:docker container list --all --filter name='^/roottestcheckings3blobsparanoid_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : No running containers for project: roottestcheckings3blobsparanoid (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 522 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:13:23 [ 522 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker networks for project roottestcheckings3blobsparanoid are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker containers for project roottestcheckings3blobsparanoid are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Docker volumes for project roottestcheckings3blobsparanoid are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:docker container list --all --filter name='^/roottestcheckings3blobsparanoid_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : No running containers for project: roottestcheckings3blobsparanoid (cluster.py:829, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:13:23 [ 522 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:13:23 [ 522 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ___________________ ERROR at setup of test_disks_app_func_ld ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_adaptive_timeouts[node_with_inf_s3_retries] ______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_backup_restore[File-encrypted_policy-local_policy-False] _ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk/test.py:26: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_disks_app_func_ln ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_backup_restore[File-encrypted_policy-local_policy-True] _ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk/test.py:26: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node ... E Pulling resolver ... E Pulling node ... pulling from altinityinfra/integr... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_disks_app_func_ls ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __________ ERROR at setup of test_query_is_canceled_with_inf_retries ___________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_upload_after_check_works ________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_disks_app_func_mv ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[br] ______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_disks_app_func_read_write _______________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[bz2] ______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_disks_app_func_rm ___________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[deflate] ____ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_remote_disk_list ____________________ [gw2] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): global cluster try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "disks_app_test", main_configs=["config.xml"], with_minio=True ) > cluster.start() test_disks_app_func/test.py:15: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling disks_app_test ... E Pulling resolver ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling disks_app_test ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling disks_app_test ... digest: sha256:8a2c68e2d63d82c826... E Pulling disks_app_test ... status: image is up to date for a... E Pulling disks_app_test ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[gzip] _____ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[lz4] ______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[none] _____ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[xz] ______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____ ERROR at setup of test_upload_s3_fail_create_multi_part_upload[zstd] _____ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[br] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[none] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[xz] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______ ERROR at setup of test_when_s3_broken_pipe_at_upload_is_retried ________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_when_s3_connection_refused_is_retried _________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/s3_retries.xml", ], with_minio=True, ) cluster.add_instance( "node_with_inf_s3_retries", main_configs=[ "configs/storage_conf.xml", ], user_configs=[ "configs/setting.xml", "configs/inf_s3_retries.xml", ], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_checking_s3_blobs_paranoid/test.py:38: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/.env', '--project-name', 'roottestcheckings3blobsparanoid', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_checking_s3_blobs_paranoid/_instances_0/node_with_inf_s3_retries/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node_with_inf_s3_retries ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling node_with_inf_s3_retries ... pulling from altinityinfra/integr... E Pulling node_with_inf_s3_retries ... digest: sha256:8a2c68e2d63d82c826... E Pulling node_with_inf_s3_retries ... status: image is up to date for a... E Pulling node_with_inf_s3_retries ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ============================== slowest durations =============================== 280.10s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 280.06s setup test_disks_app_func/test.py::test_disks_app_func_cp 280.05s setup test_encrypted_disk/test.py::test_add_keys 49.65s call test_disk_over_web_server/test.py::test_unavailable_server 47.24s setup test_disk_over_web_server/test.py::test_cache[node2] 34.22s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 33.80s call test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 32.73s setup test_ddl_alter_query/test.py::test_alter 31.39s setup test_default_database_on_cluster/test.py::test_default_database_on_cluster 31.14s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 29.47s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 25.74s setup test_distributed_ddl_password/test.py::test_alter 22.66s setup test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 22.18s setup test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 17.85s call test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 16.69s call test_cgroup_limit/test.py::test_cgroup_cpu_limit 15.86s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 15.78s setup test_cleanup_after_start/test.py::test_old_dirs_cleanup 15.60s setup test_buffer_profile/test.py::test_buffer_profile 15.27s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 15.16s setup test_aggregation_memory_efficient/test.py::test_remote 13.63s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 11.64s call test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 11.28s call test_disk_over_web_server/test.py::test_cache[node2] 10.57s setup test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 9.89s setup test_enabling_access_management/test.py::test_enabling_access_management 9.79s call test_disk_over_web_server/test.py::test_usage[node2] 9.45s teardown test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 8.53s setup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 8.51s teardown test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 8.41s teardown test_backup_restore_on_cluster/test.py::test_tables_dependency 7.99s call test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 7.92s call test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 7.70s teardown test_distributed_config/test.py::test_distibuted_settings 7.64s setup test_distributed_config/test.py::test_distibuted_settings 7.52s call test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 7.23s call test_backup_restore_on_cluster/test.py::test_tables_dependency 6.55s call test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 6.52s call test_cleanup_after_start/test.py::test_old_dirs_cleanup 6.41s teardown test_disk_over_web_server/test.py::test_usage[node2] 6.27s teardown test_distributed_ddl_password/test.py::test_truncate 6.23s call test_backup_restore_on_cluster/test.py::test_mutation 6.02s setup test_distributed_system_query/test.py::test_start_and_stop_replica_send 5.90s call test_backup_restore_on_cluster/test.py::test_replicated_database_async 5.86s teardown test_default_database_on_cluster/test.py::test_default_database_on_cluster 5.79s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 5.72s call test_backup_restore_on_cluster/test.py::test_required_privileges 5.69s call test_distributed_ddl_password/test.py::test_alter 5.21s call test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 5.15s teardown test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 4.91s teardown test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 4.81s teardown test_enabling_access_management/test.py::test_enabling_access_management 4.81s teardown test_distributed_system_query/test.py::test_start_and_stop_replica_send 4.67s call test_backup_restore_on_cluster/test.py::test_replicated_database 4.65s teardown test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 4.56s teardown test_buffer_profile/test.py::test_default_profile 4.53s teardown test_aggregation_memory_efficient/test.py::test_remote 4.31s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 4.20s call test_distributed_ddl_password/test.py::test_truncate 4.14s setup test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 4.14s call test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 4.11s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 4.09s call test_backup_restore_on_cluster/test.py::test_replicated_table 4.09s teardown test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 4.07s teardown test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 4.00s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 3.97s call test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 3.96s call test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 3.95s call test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 3.82s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 3.79s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 3.58s call test_backup_restore_on_cluster/test.py::test_projection 3.55s call test_backup_restore_on_cluster/test.py::test_system_users 3.31s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 3.24s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 3.16s teardown test_cleanup_after_start/test.py::test_old_dirs_cleanup 3.07s call test_default_database_on_cluster/test.py::test_default_database_on_cluster 3.06s call test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 3.06s call test_backup_restore_on_cluster/test.py::test_system_functions 3.01s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 2.96s call test_backup_restore_on_cluster/test.py::test_file_deduplication 2.86s call test_ddl_alter_query/test.py::test_alter 2.85s call test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 2.72s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 2.23s call test_aggregation_memory_efficient/test.py::test_remote 2.12s call test_backup_restore_on_cluster/test.py::test_empty_replicated_table 2.11s call test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 2.10s call test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 1.77s call test_disk_over_web_server/test.py::test_replicated_database 1.56s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 1.51s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 1.51s call test_distributed_system_query/test.py::test_start_and_stop_replica_send 1.45s call test_enabling_access_management/test.py::test_enabling_access_management 1.40s call test_distributed_config/test.py::test_distibuted_settings 1.35s call test_disk_over_web_server/test.py::test_incorrect_usage 1.35s call test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 1.31s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 1.31s teardown test_backup_restore_on_cluster/test.py::test_projection 1.27s teardown test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 1.27s teardown test_backup_restore_on_cluster/test.py::test_system_functions 1.27s teardown test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 1.27s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_async 1.27s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 1.27s teardown test_backup_restore_on_cluster/test.py::test_required_privileges 1.27s teardown test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 1.27s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 1.27s teardown test_backup_restore_on_cluster/test.py::test_replicated_table 1.27s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 1.22s teardown test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 1.22s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 1.21s teardown test_backup_restore_on_cluster/test.py::test_replicated_database 1.21s teardown test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 1.17s teardown test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 1.17s teardown test_backup_restore_on_cluster/test.py::test_system_users 1.17s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 1.16s teardown test_backup_restore_on_cluster/test.py::test_mutation 1.16s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 1.13s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 1.12s teardown test_backup_restore_on_cluster/test.py::test_file_deduplication 1.12s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 1.12s teardown test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 1.11s teardown test_backup_restore_on_cluster/test.py::test_empty_replicated_table 1.07s teardown test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 0.80s call test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 0.68s call test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.60s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.51s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 0.48s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.47s call test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.47s teardown test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.43s call test_buffer_profile/test.py::test_buffer_profile 0.43s call test_buffer_profile/test.py::test_default_profile 0.39s call test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.00s teardown test_disk_over_web_server/test.py::test_cache[node2] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 0.00s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 0.00s setup test_cgroup_limit/test.py::test_cgroup_cpu_limit 0.00s setup test_backup_restore_on_cluster/test.py::test_system_users 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] 0.00s setup test_backup_restore_on_cluster/test.py::test_tables_dependency 0.00s teardown test_distributed_ddl_password/test.py::test_alter 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 0.00s setup test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 0.00s setup test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_async 0.00s teardown test_disk_over_web_server/test.py::test_unavailable_server 0.00s setup test_backup_restore_on_cluster/test.py::test_mutation 0.00s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 0.00s setup test_disk_over_web_server/test.py::test_usage[node2] 0.00s teardown test_ddl_alter_query/test.py::test_alter 0.00s setup test_backup_restore_on_cluster/test.py::test_empty_replicated_table 0.00s setup test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 0.00s setup test_disk_over_web_server/test.py::test_incorrect_usage 0.00s setup test_buffer_profile/test.py::test_default_profile 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 0.00s setup test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 0.00s teardown test_disks_app_func/test.py::test_remote_disk_list 0.00s setup test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database 0.00s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 0.00s setup test_disk_over_web_server/test.py::test_replicated_database 0.00s setup test_distributed_ddl_password/test.py::test_truncate 0.00s setup test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 0.00s setup test_backup_restore_on_cluster/test.py::test_system_functions 0.00s teardown test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 0.00s setup test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 0.00s setup test_backup_restore_on_cluster/test.py::test_projection 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.00s setup test_disk_over_web_server/test.py::test_unavailable_server 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table 0.00s setup test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 0.00s setup test_backup_restore_on_cluster/test.py::test_required_privileges 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_cp 0.00s teardown test_disk_over_web_server/test.py::test_incorrect_usage 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 0.00s teardown test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 0.00s setup test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 0.00s teardown test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True] 0.00s setup test_backup_restore_on_cluster/test.py::test_file_deduplication 0.00s setup test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 0.00s teardown test_encrypted_disk/test.py::test_add_keys 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] 0.00s teardown test_buffer_profile/test.py::test_buffer_profile 0.00s setup test_disks_app_func/test.py::test_disks_app_func_rm 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] 0.00s setup test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_read_write 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ln 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ls 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_mv 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ld 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_rm 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.00s teardown test_encrypted_disk/test.py::test_add_keys_with_id 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] 0.00s setup test_disks_app_func/test.py::test_disks_app_func_mv 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.00s teardown test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ld 0.00s setup test_disks_app_func/test.py::test_disks_app_func_read_write 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.00s setup test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True] 0.00s setup test_disks_app_func/test.py::test_remote_disk_list 0.00s teardown test_disk_over_web_server/test.py::test_replicated_database 0.00s teardown test_cgroup_limit/test.py::test_cgroup_cpu_limit 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ls 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ln 0.00s setup test_encrypted_disk/test.py::test_add_keys_with_id 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.00s setup test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False] 0.00s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] =========================== short test summary info ============================ ERROR test_encrypted_disk/test.py::test_add_keys - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_disks_app_func/test.py::test_disks_app_func_cp - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_encrypted_disk/test.py::test_add_keys_with_id - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/.env', '--project-name', 'roottestencrypteddisk', '--file', '/ClickHouse/tests/integration/test_encrypted_disk/_instances_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] ERROR test_disks_app_func/test.py::test_disks_app_func_ld - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] ERROR test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False] ERROR test_disks_app_func/test.py::test_disks_app_func_ln - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True] ERROR test_disks_app_func/test.py::test_disks_app_func_ls - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works ERROR test_disks_app_func/test.py::test_disks_app_func_mv - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] ERROR test_disks_app_func/test.py::test_disks_app_func_read_write - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] ERROR test_disks_app_func/test.py::test_disks_app_func_rm - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] ERROR test_disks_app_func/test.py::test_remote_disk_list - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/.env', '--project-name', 'roottestdisksappfunc', '--file', '/ClickHouse/tests/integration/test_disks_app_func/_instances_0/disks_app_test/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] ERROR test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] ERROR test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] PASSED test_buffer_profile/test.py::test_buffer_profile PASSED test_buffer_profile/test.py::test_default_profile PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection PASSED test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible PASSED test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies PASSED test_ddl_alter_query/test.py::test_alter PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] PASSED test_aggregation_memory_efficient/test.py::test_remote PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] PASSED test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica PASSED test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default PASSED test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes PASSED test_backup_restore_on_cluster/test.py::test_empty_replicated_table PASSED test_backup_restore_on_cluster/test.py::test_file_deduplication PASSED test_disk_over_web_server/test.py::test_cache[node2] PASSED test_distributed_ddl_password/test.py::test_alter PASSED test_backup_restore_on_cluster/test.py::test_get_error_from_other_host PASSED test_disk_over_web_server/test.py::test_incorrect_usage PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] PASSED test_disk_over_web_server/test.py::test_replicated_database PASSED test_distributed_ddl_password/test.py::test_truncate PASSED test_config_xml_yaml_mix/test.py::test_extra_yaml_mix PASSED test_backup_restore_on_cluster/test.py::test_keeper_value_max_size PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async PASSED test_backup_restore_on_cluster/test.py::test_mutation PASSED test_detached_parts_metrics/test.py::test_numbers_of_detached_parts PASSED test_backup_restore_on_cluster/test.py::test_projection PASSED test_backup_restore_on_cluster/test.py::test_replicated_database PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_async PASSED test_cleanup_after_start/test.py::test_old_dirs_cleanup PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts PASSED test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts PASSED test_backup_restore_on_cluster/test.py::test_replicated_table PASSED test_distributed_system_query/test.py::test_start_and_stop_replica_send PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster PASSED test_disk_over_web_server/test.py::test_unavailable_server PASSED test_default_database_on_cluster/test.py::test_default_database_on_cluster PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert PASSED test_cgroup_limit/test.py::test_cgroup_cpu_limit PASSED test_disk_over_web_server/test.py::test_usage[node2] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge PASSED test_distributed_config/test.py::test_distibuted_settings PASSED test_enabling_access_management/test.py::test_enabling_access_management PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath PASSED test_backup_restore_on_cluster/test.py::test_required_privileges PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] PASSED test_backup_restore_on_cluster/test.py::test_system_functions PASSED test_backup_restore_on_cluster/test.py::test_system_users PASSED test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def PASSED test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty PASSED test_backup_restore_on_cluster/test.py::test_tables_dependency ================== 62 passed, 38 errors in 284.06s (0:04:44) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 437, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_ugh3i4 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_refused_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv test_disks_app_func/test.py::test_disks_app_func_read_write test_disks_app_func/test.py::test_disks_app_func_rm test_disks_app_func/test.py::test_remote_disk_list test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_password/test.py::test_alter test_distributed_ddl_password/test.py::test_truncate test_distributed_system_query/test.py::test_start_and_stop_replica_send test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk/test.py::test_add_keys test_encrypted_disk/test.py::test_add_keys_with_id 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-False]' 'test_encrypted_disk/test.py::test_backup_restore[File-encrypted_policy-local_policy-True]' -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 ' returned non-zero exit status 1.